基于优势学习的深度Q网络

强化学习问题中，同一状态下不同动作所对应的状态-动作值存在差距过小的现象，Q-Learning算法采用MAX进行动作选择时会出现过估计问题，且结合了Q-Learning的深度Q网络（Deep Q Net）同样存在过估计问题。为了缓解深度Q网络中存在的过估计问题，提出一种基于优势学习的深度Q网络，通过优势学习的方法构造一个更正项，利用目标值网络对更正项进行建模，同时与深度Q网络的评估函数进行求和作为新的评估函数。当选择的动作是最优动作时，更正项为零，不对评估函数的值进行改动，当选择的动作不是最优动作时，更正项的值为负，降低了非最优动作的评估值。和传统的深度Q网络相比，基于优势学习的深度Q网络在Playing Atari 2600的控制问题breakout、seaquest、phoenix、amidar中取得了更高的平均奖赏值，在krull、seaquest中取得了更加稳定的策略。     

OPM3要素对项目组合管理能力影响的SD建模与仿真

根据组织项目管理成熟度模型（OPM3），确定影响项目组合管理能力的OPM3要素，分析OPM3要素与项目组合管理能力的因果关系，构建系统动力学模型，仿真模拟OPM3要素对项目组合管理能力的影响。仿真结果表明：OPM3要素与项目组合管理能力正相关；OPM3要素对项目组合管理能力的影响在短期内并不显著；在OPM3要素中，对项目组合管理能力影响较为显著的是战略执行与规划、组织领导能力和信息分析。     

基于ATP-ABE的访问控制方案

对访问控制机制中存在的安全性和有效性的问题进行了研究，提出了基于访问树剪枝的属性加密ATP-ABE（Access Tree Pruning Attribute Based Encryption）的访问控制方案。当ATP-ABE算法需要访问它的树型结构访问策略时，通过剪枝处理访问树结构中包含用户ID属性节点的分支，提高了用户所有者DO（Data Owner）管理和控制属性的效率，更加有效地实现了数据共享。还为访问树结构设计了许可访问属性，使DO仍保留共享数据的关键属性，并且能够完全控制它们的共享数据。基于决策双线性密钥交换算法DBDH（Decisional Bilinear Diffie-Hellman）假设分析了ATP-ABE方案的安全性，研究结果表明与两种经典ABE方案比较，ATP-ABE更加有效地减少了算法的系统设置、私钥生成、密文大小、用户属性撤销以及加解密过程中的计算开销，并给出了定量结论。     

考虑节点过载的碳排放空间关联系统级联失效模型

为提高突发事件级联失效对现实碳排放关联系统破坏程度的评估可信性，在传统复杂网络的"负载-容量"级联失效模型基础上，考虑个体成员对负载的冗余能力，提出一种过载失效概率，构建了考虑节点过载状态的级联失效模型，并基于节点特性提出了6种过载节点负载分配策略。仿真结果表明：在过载节点负载分配策略中，综合分配策略整体上较优，能够有效控制级联失效的规模，增加网络鲁棒性；在一定范围内提升过载参数有助于降低级联失效的影响，但提升到一定程度时改善效果不明显；在不同负载分配策略下，剩余系数存在一个最优值，容量可调参数存在最优区间，可以使碳排放关联网络保持较好鲁棒性的同时，花费较小的构建成本，其中紧密度分配策略对应的网络构建成本较高。     

基于强化学习的HP模型优化方法研究

蛋白质结构预测问题一直是生物信息学中的重要问题。基于疏水极性模型的蛋白质二维结构预测问题是一个典型的NP难问题。目前疏水极性模型优化的方法有贪心算法、粒子群算法、遗传算法、蚁群算法和蒙特卡罗模拟方法等，但这些方法成功收敛的鲁棒性不高，容易陷入局部最优。由此提出一种基于强化学习的HP模型优化方法，利用其连续马尔可夫最优决策与最大化全局累计回报的特点，在全状态空间中，构建基于能量函数的奖赏函数，引入刚性重叠检测规则，充分挖掘生物序列中的全局进化关系，从而进行有效与稳定的预测。以3条经典论文序列和5条Uniref50序列为实验对象，与贪心算法和粒子群算法分别进行了鲁棒性、收敛性与运行时间的比较。贪心算法只能在62.5%的序列上进行收敛，该文方法能在5万次训练后稳定的在所有序列上达到了收敛。与粒子群算法相比，两者都能找到最低能量结构，但该文的运行时间较粒子群算法降低了63.9%。     

基于卷积神经网络优化TLD运动手势跟踪算法

针对TLD（Tracking-Learning-Detection）算法在光照变化不均、遮挡严重、跟踪目标模糊等情况下会出现跟踪失败的问题，提出一种基于卷积神经网络优化TLD运动手势跟踪算法。选取手势特征作正样本，其背景作负样本，获取手势HOG特征并投入到卷积神经网络中加以训练，得到手势检测分类器，从而确定目标手势区域，实现手势的自动识别；再利用TLD算法对手势进行跟踪与学习，对正负样本进行估计检测并实时校正，同时运用SURF特征匹配更新跟踪器。实验结果验证，该算法对比TLD经典算法跟踪精度提高了4.24%，增强了运动手势的跟踪效果，相比经典跟踪算法拥有更高鲁棒性。     

The validation and further development of a multidimensional cognitive load scale for virtual environments

Measuring cognitive load is important in virtual learning environments (VLE). Thus, valid and reliable measures of cognitive load are important to support instructional design in VLE. Through three studies, we investigated the validity and reliability of Leppink's Cognitive Load Scale (CLS) and developed the extraneous cognitive load (EL) dimension into three sub-scales relevant for VLE: EL instructions, EL interaction, and EL environment. We investigated the validity of the measures using the Partial Credit Model (PCM), Confirmatory Factor Analysis (CFA), and correlations with retention tests. Study 1 (n = 73) investigated the adapted version of the CLS. Study 2 describes the development and validation of the Multidimensional Cognitive Load Scale for Virtual Environments (MCLSVE), with 140 students in higher education. Study 3 tested the generalizability of the results with 121 higher education students in a more complicated VLE. The results provide initial evidence for the validity and reliability of the MCLSVE.     

Effect of heat treatment and zircon addition on the properties of low-cement castables based on recycled alumina grog

In this investigation, low-cement castables were prepared using 70% alumina grog aggregates obtained from crushed alumina brick waste. The aggregates were thermally treated at 1550 °C for 3 h. Four types of low-cement castables were prepared with various types of aggregates (alumina grog with or without thermal treatment) and fillers (with or without zircon addition), and they were evaluated in terms of their physical, thermal, and chemical properties. Microstructural analysis via scanning electron microscopy (SEM) was performed on the castables before and after slag attack. Compared to the other fabricated castables, the thermally treated alumina grog castables with zircon showed better physical properties, such as a higher bulk density, cold crushing strength, and modulus of rupture and a lower apparent porosity and water absorption. In addition, they had a higher positive linear thermal expansion, refractoriness under load, permanent linear change, and hot modulus of rupture. The results of the SEM with energy dispersive X-ray analysis of the prepared castables confirmed that the mullite and anorthite phases were predominant when zircon was not added and the zircon–mullite phase additionally appeared upon the incorporation of zircon. A quantitative elemental analysis via X-ray fluorescence spectroscopy was employed to determine the composition of the castables. X-ray diffraction analysis showed that the alumina grog castables had a high mullite and low anorthite content, and the thermally treated alumina grog had a high anorthite, low mullite, and high zircon content. The improvement in the mechanical and thermo-mechanical properties of the castables with thermally treated alumina grog and added zircon can be attributed to the formation of the zircon–mullite phase with a low mullite phase content.     

Effects of external light load on posture and foot pressure distribution in young adults: A pilot study

Holding an asymmetrical load, like a rucksack, grocery bag, or travel backpack, is a part of daily and occupational activities. This pilot study was aimed to determine the effects of light, asymmetrical, handheld load on the body posture and foot pressure distribution in young adults. Thirteen young volunteers, free of any injury or pain, took part in the study (aged 21.53 ± 1.10 years). All the study participants were right-handed. An additional load (4 kg, placed in the rucksack) was asymmetrically held in each hand while standing still. For evaluation of the posture and foot pressure distribution, the investigation focused on three positions, i.e., no-load, a rucksack in the right hand, a rucksack in the left hand. We used a surface topography system and force platform for evaluation of the body posture and foot pressure examination, respectively. The results showed that the main changes in the body posture caused by an external load application manifested in trunk imbalance. The trunk was shifted in the direction opposite to the load. Trunk imbalance changes were statistically significant in all three comparisons (p = 0.001). Interestingly, changes in the rotations and lateral deviation seem to be dependent on the hand dominance. Greater foot pressure was observed on the loaded limb (p < 0.01), and highly significant differences were noted between the left and right foot in both loaded postures (p < 0.001). Further research needs to be done to check if lateralization is connected with body posture while holding an external load.